rack (someone's) nerves

Translations
mettre les nerfs de quelqu’un à rude épreuve
Definitions
To irritate, annoy, or upset someone, often repeatedly or to a great extent.